• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    Discloses a green signal time prolonging method, system, and apparatus dedicated for an old person. Includes: collecting facial information of an old person by using a face identification method; obtaining facial information of all pedestrians within a sidewalk monitoring range, conducting similarity measurement on the facial information , determining the old person whose identity has been verified, and marking the old person, conducting real-time tracking on the marked old person to obtain a street-crossing track, calculating, according to the street-crossing track of the old person, an average speed for crossing a street by the old person, obtaining a distance between the old person and an end point of a sidewalk, recording the distance as a remaining distance; determining a shortest safe street-crossing time according to the average speed and the remaining distance; and setting a countdown of a prolonged green signal time according to the shortest safe street-crossing time.
    公开号:NL2025140A
    申请号:NL2025140
    申请日:2020-03-16
    公开日:2021-05-17
    发明作者:Liu Zhaohui；Wang Chao；Song Runze；Yang Zhifa；Wang Junbo；Zhang Dedong；Li Muzi
    申请人:Univ Shandong Science & Tech；
    IPC主号:
    专利说明:

    GREEN SIGNAL CONTROL METHOD AND APPARATUS DEDICATED FOR OLDPERSON CROSSING THE STREET
    TECHNICAL FIELD The present invention relates to the field of pedestrian re-identification technologies, and in particular, to a green signal time prolonging method, system, and apparatus dedicated for an old person.
    BACKGROUND As China gradually enters an aging society, travel safety of the elderly is gradually getting more attention. Due to somatic functions of the elderly, a street-crossing behavior of an old person is very different from that of an average person. An existing street-crossing facility has very great drawback, and when a pedestrian crosses a street, a speed designed for crossing a street is excessively high, and a green light time is relatively short, and therefore the old person cannot cross the street safely. To resolve a street-crossing safety problem of the elderly, it is necessary to design a green signal time prolonging method and apparatus suitable for an old person. A green signal time prolonging apparatus suitable for an old person that is more studied in the current field is to use a card swiping control manner. After an old person places a magcard in a card-swiping area, a computer or an intelligent signal control machine calculates a control signal, and control a green light time of a traffic signal light of a sidewalk to be prolonged by a fixed time and a red light time of a corresponding motor vehicle lane to be prolonged, so that a special group has enough time to pass an intersection and their personal safety is ensured. However, this type of apparatus requires that an old person carries around a dedicated magnetic card. The dedicated magnetic card has relatively poor reliability and cannot prevent other people from using identity information of the old person. In addition, the prolonged time is a fixed passing time, and consequently it is impossible to ensure whether the old person can pass safely within the fixed time, and there may be an excessive prolonged green signal time, thereby delaying passing of motor vehicles and leading to relatively poor self-adaptability.
    SUMMARY An objective of the present invention is to provide a green signal time prolonging apparatus, system, and apparatus dedicated for an old person, so as to resolve a street-crossing safety problem of the elderly and furthest reduce a delay caused to motor vehicles. To achieve the above purpose, the present invention provides the following technical solutions. A green signal time prolonging method dedicated for an old person based on a pedestrian re-identification technology includes:
    collecting facial information of an old person by using a face identification method; obtaining facial information of all pedestrians within a sidewalk monitoring range; conducting similarity measurement on the facial information of the old person and the facial information of the pedestrians, determining the old person whose identity has been verified, and marking the old person; conducting real-time tracking on the marked old person to obtain a street-crossing track; calculating, according to the street-crossing track of the old person, an average speed for crossing a street by the old person; obtaining a distance between the old person and an end point of a sidewalk, and recording the distance as a remaining distance; determining a shortest safe street-crossing time according to the average speed and the remaining distance; and setting a countdown of a prolonged green signal time according to the shortest safe street-crossing time.
    Optionally, the conducting similarity measurement on the facial information of the old person and the facial information of the pedestrians, determining the old person whose identity has been verified, and marking the old person specifically includes: extracting feature information from the facial information of the old person; conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain multiple similarities; determining whether each similarity reaches a specified similarity threshold; if yes, sorting similarities that satisfy the condition, determining an old person corresponding to a maximum similarity as the old person whose identity has been verified, and marking the old person; and triggering a touch signal light to start a green signal time prolonging function; or if no, returning to the step of conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain similarities.
    Optionally, the conducting real-time tracking on the marked old person to obtain a street-crossing track specifically includes: conducting effective extraction of a feature point of each frame of the marked old person to obtain multiple effective feature points; tracking each feature point by using a Kalman filtering method to obtain a feature point track; and characterizing the street-crossing track of the old person by using the multiple effective feature points.
    Optionally, the calculating, according to the street-crossing track of the old person, an average speed for crossing a street by the old person specifically includes: obtaining a time at which the old person walks into the sidewalk monitoring area and a distance the old person has walked; and calculating, according to the time and the distance, the average speed for crossing the street by the old person.
    To achieve the above purpose, the present invention further provides the following technical solution.
    A green signal time prolonging system dedicated for an old person based on a pedestrian re-identification technology includes: a face identification module, configured to collect facial information of an old person by using a face identification method, an obtaining module, configured to obtain facial information of all pedestrians within a sidewalk monitoring range; an old person identity determining module, configured to conduct similarity measurement on the facial information of the old person and the facial information of the pedestrians, determine the old person whose identity has been verified, and mark the old person; a street-crossing track determining module, configured to conduct real-time tracking on the marked old person to obtain a street-crossing track; an average speed determining module, configured to calculate, according to the street-crossing track of the old person, an average speed for crossing a street by the old person; a remaining distance determining module, configured to obtain a distance between the old person and an end point of a sidewalk, and record the distance as a remaining distance; a shortest safe street-crossing time determining module, configured to determine a shortest safe street-crossing time according to the average speed and the remaining distance; and a prolonged green signal time determining module, configured to set a countdown of a prolonged green signal time according to the shortest safe street-crossing time.
    Optionally, the old person identity determining module specifically includes: a feature information extraction unit, configured to extract feature information from the facial information of the old person; a similarity comparison unit, configured to conduct similarity measurement on the feature information and the facial information of the pedestrians, to obtain multiple similarities; a determining unit, configured to determine whether each similarity reaches a specified similarity threshold; an old person identity determining unit, configured to: when the similarity reaches the specified similarity threshold, sort similarities that satisfy the condition, determine an old person corresponding to a maximum similarity as the old person whose identity has been verified, and mark the old person; a triggering unit, configured to trigger a touch signal light to start a green signal time prolonging function; and a returning unit, configured to: when the similarity does not reach the specified similarity threshold, return to the step of conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain similarities.
    Optionally, the street-crossing track determining module specifically includes: a feature point extraction unit, configured to conduct effective extraction of a feature point of each frame of the marked old person to obtain multiple effective feature points; a tracking unit, configured to track each feature point by using a Kalman filtering method to obtain a feature point track; and a street-crossing track determining unit, configured to characterize the street-crossing track ofthe old person by using the multiple effective feature points.
    Optionally, the average speed determining module specifically includes: an obtaining unit, configured to obtain a time at which the old person walks into the sidewalk monitoring area and a distance the old person has walked; and an average speed determining unit, configured to calculate, according to the time and the distance, the average speed for crossing the street by the old person.
    To achieve the above purpose, the present invention further provides the following technical solution.
    A green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology includes a face identification module, a camera, a touch control signal light, a communications module, a pedestrian re-identification module, a controller, and a display, wherein the touch control signal light is configured to be triggered when an old person crosses a street, the camera is configured to acquire images of all pedestrians within a sidewalk monitoring range and a position image of a street-crossing old person; the face identification module is configured to collect image information of an old person; the communications module is connected to both the face identification module, the controller, and the camera; the communications module is configured to send, to the controller, the image information collected by the face identification module and the images of all the pedestrians acquired by the camera within the sidewalk monitoring range; the controller is configured to receive the images of all the pedestrians acquired by the camera within the sidewalk monitoring range and the image information collected by the face identification module, and determine identity information of the street-crossing old person from the images of all the pedestrians according to the image information collected by the face identification module; the camera is connected to the pedestrian re-identification module; the pedestrian re-identification module is configured to obtain a street-crossing track of the old person according to the location image of the street-crossing old 5 person acquired by the camera; the controller is connected to both the pedestrian re-identification module and the display; and the controller is configured to determine a prolonged green signal time according to the street-crossing track of the old person, and send the prolonged green signal time to the display for display.
    According to specific embodiments provided in the present invention, the present invention discloses the following technical effects:
    1. Information about an old person is collected and confirmed in a face identification manner, and this is more convenient and reliable.
    2. A pedestrian re-identification technology and a tracking technology are comprehensively used to monitor a street-crossing situation of an old person in real time, ensuring that the old person safely crosses a street within a monitoring range.
    3. Green signal time prolonging has self-adaptability, a countdown function of a prolonged green signal time is appropriately designed, and the prolonged green signal time may be adjusted according to a real-time passing situation of the old person, furthest reducing a traffic delay caused to motor vehicles while ensuring that the old person safely passes.
    BRIEF DESCRIPTION OF THE DRAWINGS To describe the technical solutions in the embodiments of the present invention or in the prior art more clearly, the following briefly introduces the accompanying drawings required for describing the embodiments. Apparently, the accompanying drawings in the following description show merely some embodiments of the present invention, and a person of ordinary skill in the art may still derive other drawings from these accompanying drawings without creative efforts.
    FIG 1 is a flowchart of a green signal time prolonging method dedicated for an old person based on a pedestrian re-identification technology according to the present invention; FIG 2 is a structure diagram of a green signal time prolonging system dedicated for an old person based on a pedestrian re-identification technology according to the present invention; FIG 3 is a schematic composition diagram of a green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology according to the present invention; and FIG 4 is a schematic layout diagram of a green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology according to the present invention.
    DETAILED DESCRIPTION The following clearly and completely describes the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are merely a part rather than all of the embodiments of the present invention. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
    An objective of the present invention is to provide a green signal time prolonging apparatus, system, and apparatus dedicated for an old person, so as to resolve a street-crossing safety problem of the elderly and furthest reduce a delay caused to motor vehicles.
    To make the foregoing objective, features, and advantages of the present invention clearer and more comprehensible, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
    FIG 1 is a flowchart of a green signal time prolonging method dedicated for an old person based on a pedestrian re-identification technology according to the present invention. As shown in FIG 1, the green signal time prolonging method dedicated for an old person based on a pedestrian re-identification technology includes the following steps: Step 101. Collect facial information of an old person by using a face identification method, where the step specifically includes: obtaining an image by using a face identification module and a camera, where the image may be a stationary or dynamic video sequence; conducting preprocessing on collected image information, where the preprocessing includes image area segmentation, dimension normalization, gray level normalization, and the like; conducting detection on a preprocessed image, to detect whether the image includes a human face, a number of human faces, and an area and a position including a human face; and extracting the facial information of the old person.
    Step 102. Obtain facial information of all pedestrians within a sidewalk monitoring range.
    Step 103. Conduct similarity measurement on the facial information of the old person and the facial information of the pedestrians, determine the old person whose identity has been verified, and mark the old person, where the step specifically includes: extracting feature information from the facial information of the old person; conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain multiple similarities; determining whether each similarity reaches a specified similarity threshold; if yes, sorting similarities that satisfy the condition, and determining an old person corresponding to a maximum similarity as the old person whose identity has been verified, and marking the old person, that is, sorting feature information whose similarity reaches a specific degree, marking feature information with a highest similarity, and determining an old person corresponding to the highest similarity as the old person whose identity has been verified; and triggering a touch signal light to start a green signal time prolonging function; or if no, returning to the step of conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain similarities.
    Step 104. Conduct real-time tracking on the marked old person to obtain a street-crossing track, where the step specifically includes: conducting effective extraction of a feature point of each frame of the marked old person to obtain multiple effective feature points; tracking each feature point by using a Kalman filtering method to obtain a feature point track; and characterizing the street-crossing track of the old person by using the multiple effective feature points.
    A Kalman filtering method is used to track a target. First, a feature factor that can be used to fully describe the target is found to differentiate a pedestrian target and another object, where a commonly used feature factor is a gray scale, a color, a texture, or even some motion information feature; and a color feature is selected for particle observation for real-time tracking of the target.
    Specific steps for pedestrian tracking are as follows:
    1. Conduct pedestrian detection in a first frame of a monitoring video sequence to obtain a detection target, calculate a color histogram of the detection target, assume that prior distribution obeys the Gaussian distribution, and initialize particles, where a particle number is N, and each weight is I/N, that is, (akrl/N ba
    2. Obtain a particle state (ap wij at a moment k based on a particle state at a moment k-1 according to a system state transition model.
    The system state transition model includes state and measurement equations used during track extraction. ak = & (x -DAk -1+ Dk -1 bx = Ika + Fx In the formulas, a; is an nx1-dimensional state vector of a system state, ax; is an n> l-dimensional state vector of the system state at a moment tii; bx is an mx1-dimensional vector of an observed system state; 91 1S an nxn-dimensional state transition matrix from the moment tx-1to a moment ty, Ir 1s an mxn-dimensional measurement matrix at the moment tx; Dig
    1s an nx 1-dimensional random vector with random interference at the moment t:1; and Fy is an mx*1-dimensional observation noise vector at the moment tx.
    3. For each particle, calculate a similarity Ly, according to an observation model by using the color histogram, where 1 represents 1 to n; and obtain a newest particle weight through similarity normalization: Wo Leal - Ls :
    4. Conduct similarity measurement according to the weight, and if n pedestrians are detected, Noi estimate a posteriori probability 2 it according to a weight of each particle in a frame as reliability Tw , and use a pedestrian whose reliability exceeds a threshold To and whose ranking is highest as a target pedestrian for tracking.
    5. Repeat the foregoing operation on a next frame, and continue to conduct pedestrian tracking, Because a linear relationship between two states at a moment t and a moment t-1 is described in a Kalman filtering algorithm, a state at the moment t can be obtained only by inputting an observed quantity at the moment t—1 based on space-time information, while the input observed quantity needs to be based on specific space-time information. Therefore, with reference to context space-time information, a position in which a target is marked in a next frame of image is predicted, and two-dimension search is conducted to obtain a foreground with a largest correlation with a contour to which the predicted position point belongs, to implement pedestrian tracking; a feature track is extracted; and after track extraction and tracking, a track feature on the image is converted to a true movement track feature, so as to obtain the street-crossing track of the old person.
    Step 105. Calculate, according to the street-crossing track of the old person, an average speed for crossing a street by the old person, where the step specifically includes: obtaining a time at which the old person walks into the sidewalk monitoring area and a distance for which the old person has walked; and calculating, according to the time and the distance, the average speed for crossing the street by the old person.
    Step 106. Obtain a distance between the old person and an end point of a sidewalk, and record the distance as a remaining distance.
    Step 107. Determine a shortest safe street-crossing time according to the average speed and the remaining distance.
    Step 108. Set a countdown of a prolonged green signal time according to the shortest safe street-crossing time.
    A yellow line is set in a target position of a video monitoring screen. When a central coordinate of a detection frame of a target old person intersects with any coordinate within the yellow line, a count of a counter is increased by 1. In this case, a countdown of a prolonged green signal time is set by calculating a shortest safe street-crossing time. This step is conducted to furthest reduce a traffic delay caused to motor vehicles while ensuring that the old person safely passes.
    In the present invention, based on a pedestrian re-identification technology, pedestrian detection, pedestrian re-identification, pedestrian tracking, video detection, and the like are conducted to implement a green signal time prolonging function dedicated for an old person, implementing the following functions based on existing research:
    1. Information about an old person is collected and confirmed in a face identification manner, and this is more convenient and reliable.
    2. A pedestrian re-identification technology and a tracking technology are comprehensively used to monitor a street-crossing situation of an old person in real time, ensuring that the old person safely crosses a street within a monitoring range.
    3. Green signal time prolonging has self-adaptability, a green signal time prolonging countdown function is appropriately designed, and a prolonged green signal time may be adjusted according to a real-time passing situation of the old person, furthest reducing a traffic delay caused to motor vehicles while ensuring that the old person safely passes.
    FIG 2 is a structure diagram of a green signal time prolonging system dedicated for an old person based on a pedestrian re-identification technology according to the present invention. As shown in FIG 2, the green signal time prolonging system dedicated for an old person based on a pedestrian re-identification technology includes: a face identification module 201, configured to collect facial information of an old person by using a face identification method, an obtaining module 202, configured to obtain facial information of all pedestrians within a sidewalk monitoring range; an old person identity determining module 203, configured to conduct similarity measurement on the facial information of the old person and the facial information of the pedestrians, determine the old person whose identity has been verified, and mark the old person; a street-crossing track determining module 204, configured to conduct real-time tracking on the marked old person to obtain a street-crossing track; an average speed determining module 205, configured to calculate, according to the street-crossing track of the old person, an average speed for crossing a street by the old person;
    a remaining distance determining module 206, configured to obtain a distance between the old person and an end point of a sidewalk, and record the distance as a remaining distance; a shortest safe street-crossing time determining module 207, configured to determine a shortest safe street-crossing time according to the average speed and the remaining distance; and a prolonged green signal time determining module 208, configured to set a countdown of a prolonged green signal time according to the shortest safe street-crossing time.
    The old person identity determining module 203 specifically includes: a feature information extraction unit, configured to extract feature information from the facial information of the old person; a similarity comparison unit, configured to conduct similarity measurement on the feature information and the facial information of the pedestrians, to obtain multiple similarities; a determining unit, configured to determine whether each similarity reaches a specified similarity threshold; an old person identity determining unit, configured to: when the similarity reaches the specified similarity threshold, sort similarities that satisfy the condition, determine an old person corresponding to a maximum similarity as the old person whose identity has been verified, and mark the old person; a triggering unit, configured to trigger a touch signal light to start a green signal time prolonging function; and a returning unit, configured to: when the similarity does not reach the specified similarity threshold, return to the step of conducting similarity measurement on the feature information and the facial information of the pedestrians, to obtain similarities.
    The street-crossing track determining module 204 specifically includes: a feature point extraction unit, configured to conduct effective extraction of a feature point of each frame of the marked old person to obtain multiple effective feature points; a tracking unit, configured to track each feature point by using a Kalman filtering method to obtain a feature point track; and a street-crossing track determining unit, configured to characterize the street-crossing track of the old person by using the multiple effective feature points.
    The average speed determining module 205 specifically includes: an obtaining unit, configured to obtain a time at which the old person walks into the sidewalk monitoring area and a distance the old person has walked; and an average speed determining unit, configured to calculate, according to the time and the distance, the average speed for crossing the street by the old person.
    FIG 3 is a schematic composition diagram of a green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology according to the present invention.
    As shown in FIG 3, the green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology includes a touch control signal light 1, a face identification module 2, a communications module 3, a camera 4, a pedestrian re-identification module 5, a controller 6, and a display 7, where the touch control signal light 1 is configured to be triggered when an old person crosses a street; the camera 4 is configured to acquire images of all pedestrians within a sidewalk monitoring range and a position image of a street-crossing old person; the face identification module 2 is configured to collect image information of an old person; the communications module 3 is connected to both the face identification module 2, the controller 6, and the camera 4; the communications module 3 is configured to send, to the controller 6, the image information collected by the face identification module 2 and the images of all the pedestrians acquired by the camera 4 within the sidewalk monitoring range; the controller 6 is configured to receive the images of all the pedestrians acquired by the camera 4 within the sidewalk monitoring range and the image information collected by the face identification module 2, and determine identity information of the street-crossing old person from the images of all the pedestrians according to the image information collected by the face identification module 2; the camera 4 is connected to the pedestrian re-identification module 5; the pedestrian re-identification module 5 1s configured to obtain a street-crossing track of the old person according to the position image of the street-crossing old person acquired by the camera 4; the controller 6 is connected to both the pedestrian re-identification module 5 and the display 7; and the controller 6 is configured to determine a prolonged green signal time according to the street-crossing track of the old person, and send the prolonged green signal time to the display 7 for display.
    The pedestrian re-identification module 5 specifically includes an aligning unit, a feature extraction unit, and a feature fusion unit that are connected in sequence, where the aligning unit is configured to receive a video image sequence, and complete space alignment of the video image sequence through two-dimensional space affine transformation; the feature extraction unit is configured to extract global features of multiple frames of the video image sequence that has undergone the two-dimensional space affine transformation; and the feature fusion unit is configured to fuse the global features of the multiple frames of the video image sequence, to obtain image features of an equal length at a sequence level to determine the street-crossing track of the old person.
    FIG. 4 is a schematic layout diagram of a green signal time prolonging apparatus dedicated for an old person based on a pedestrian re-identification technology according to the present invention.
    As shown in FIG. 4, the face identification module 2 is located on one side of the sidewalk, and the touch signal light 1, the camera 4, and the display 7 are located on the other side of the sidewalk.
    Each embodiment of the present specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts between the embodiments may refer to each other.
    For a system disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and reference can be made to the method description.
    Several examples are used for illustration of the principles and implementation methods of the present invention.
    The description of the embodiments is used to help illustrate the method and its core principles of the present invention.
    In addition, those skilled in the art can make various modifications in terms of specific embodiments and scope of application in accordance with the teachings of the present invention.
    In conclusion, the content of this specification shall not be construed as a limitation to the invention.
    权利要求:
    Claims (9)
    [1]
    A method of extending a green signal specific to an elderly person and based on a pedestrian re-recognition technology, comprising the steps of: collecting facial information of an elderly person by employing a facial recognition method; obtaining facial information from all pedestrians within a pedestrian walkway monitoring range; performing similarity measurements on the facial information of the elderly person and on the facial information of the pedestrians, determination of the elderly person whose identity has been checked, and marking of the elderly person; real-time tracking of the elderly person to obtain a crosswalk; calculation, according to the elderly person's road crossing, of an average speed for the elderly person's road crossing; obtaining a distance between the elderly person and a footpath terminus, and recording the distance as a remaining distance, determining a shortest safe street crossing time according to the average speed and the remaining distance; and setting an extended time countdown period for the green signal according to the shortest safe street crossing time.
    [2]
    A method of extending a green signal specific to an elderly person and a pedestrian re-recognition technology according to claim | whereby the step of performing similarity measurements on the facial information of the elderly person and on the facial information of pedestrians, of determining the elderly person whose identity has been checked, and of marking the elderly person in particular includes: extraction of characteristic information from the elderly person's facial information; performing similarity measurements on the characteristic information and the facial information of the pedestrians to obtain multiple similarities; determining whether each similarity reaches a certain similarity threshold; if so, sorting of the similarities that meet the condition, determination of an elderly person who corresponds to a maximum similarity, as the elderly person whose identity has been checked, and marking of the elderly person, and activation of a touch signal light to perform a function to extend the time for the green signal to start; or if not, return to the step of performing similarity measurements on the characteristic information and on the pedestrian's facial information, in order to obtain similarities.
    [3]
    A method of prolonging a green signal specific to an elderly person and based on a pedestrian re-recognition technology according to claim 1, wherein the step of real-time tracking of the marked elderly person to obtain a crosswalk includes in particular : performing an efficient extraction of a characteristic point of each image of the marked elderly person to obtain a plurality of efficient characteristic points; tracking each feature point by the Kalman filtering method to obtain a trajectory of the feature points; and characterizing the elderly person's crosswalk by means of the multiple purposeful markers.
    [4]
    A method of prolonging a green signal specific to an elderly person and based on a pedestrian re-recognition technology according to claim 1, wherein the step of calculating, according to the road crossing path of the elderly person, an average speed for the road crossing of the elderly person in particular includes: obtaining a time during which the elderly person walks in the guarded area of the footpath and of a distance that the elderly person has walked; and calculation, according to time and distance, of the average speed for crossing the street by an elderly person.
    [5]
    A green signal extension system specific to an elderly person and based on a pedestrian re-recognition technology according to claim 1, comprising: a facial recognition module configured to collect facial information of an elderly person by means of a facial recognition method; an acquisition module configured to obtain facial information from all pedestrians within a footpath monitoring area; a module for determining the identity of the elderly person, which for performing similarity measurements on the facial information of the elderly person and on the facial information of the pedestrians, for determining the elderly person whose identity has been checked, and for marking the elderly person;
    a crosswalk determining module configured for real-time tracking of the elderly person to obtain a crosswalk; an average speed determination module configured to calculate, according to the elderly person's road crossing, an average speed for the elderly person's road crossing; a distance remaining module configured to obtain a distance between the elderly person and a footpath terminus and to record the distance as a remaining distance; a module for determining a shortest safe crossing time configured to determine a shortest safe crossing time according to the average speed and the remaining distance; and a green signal extended time determining module configured to set an extended time countdown period for the green signal according to the shortest safe road crossing time.
    [6]
    A green signal extension system specific to an elderly person and based on a pedestrian re-recognition technology according to claim 5, wherein the module for determining the identity of an elderly person comprises in particular: a unit for extracting characteristic information configured to extract characteristic information from the elderly person's facial information; a similarity comparison unit configured to perform similarity measurements on the characteristic information and on the pedestrian's facial information to obtain multiple similarities; a determination unit configured to determine whether each similarity reaches a particular similarity threshold; a unit for determining the identity of an elderly person, which is configured for the following: if the similarity reaches a certain similarity threshold, sorting of the similarities that meet the condition, determination of an elderly person who corresponds to a maximum similarity, if the elderly person whose identity has been checked, and marking of the elderly, and an activation unit configured to activate a touch signal light to start a function to extend the time for the green signal light; and a return unit configured to: if the similarity does not reach a certain similarity threshold, return to the step of performing similarity measurements on the characteristic information and on the pedestrian's facial information to obtain similarities.
    [7]
    A green signal extension system specific to an elderly person and based on a pedestrian re-recognition technology according to claim 5, wherein the crosswalk determination module comprises in particular: a characteristic point recovery unit, which configured to perform efficient extraction of a feature point from each image of the tagged elderly person to obtain a plurality of efficient feature points; a locating unit configured to track each feature point by the Kalman filtering method to obtain a trajectory of the feature points; and a crosswalk determining unit configured to characterize the elderly person's crosswalk by means of the multiple effective feature points.
    [8]
    A green signal extension system specific to an elderly person and based on a pedestrian re-recognition technology according to claim 5, wherein the module for determining an average speed comprises in particular: an acquisition unit which is used to obtain a time during which the elderly person walks in the footpath guard area and is configured from a distance that the elderly person has walked; and an average speed determination unit configured to calculate, according to time and distance, an average speed for the road crossing by the elderly person.
    [9]
    9. Device for extending a green signal lamp specific to an elderly person and based on pedestrian re-recognition technology, comprising a facial recognition module, a camera, a finger-operated signal lamp, a communication module, a pedestrian re-recognition module, a control, and a display, wherein the finger-operated signal light is configured to be activated when the elderly person crosses a street; the camera is configured to collect images of all pedestrians within a pedestrian walkway monitoring range and a positional image of an elderly person crossing a street; the face recognition module is configured to collect image information from an elderly person; the communication module is connected to the face recognition module, to the controller and to the camera; the communication module is configured to send the image information collected by the face recognition module and the images of all pedestrians collected by the camera within the footpath monitoring range to the controller; the controller is configured to receive the images of all pedestrians collected by the camera within the pedestrian walkway monitoring range and the image information collected by the face recognition module, to determine the identity information of the elderly crossing the street from the images of all pedestrians according to the image information collected by the facial recognition module; the camera is connected to the pedestrian's re-recognition module; re-recognition module of the pedestrian is configured to obtain a street crossing lane of the elderly person according to the location image of the elderly person crossing the street collected by the camera; the controller is connected to both the pedestrian re-recognition module and the display; and the controller is configured to determine an extended time for the green signal light according to the elderly person's road crossing, and to determine the extended time for the green signal light to the display to send for display.
    类似技术:
    公开号 | 公开日 | 专利标题
    US9679203B2|2017-06-13|Traffic violation detection
    US9685079B2|2017-06-20|Short-time stopping detection from red light camera evidentiary photos
    Keller et al.2011|The benefits of dense stereo for pedestrian detection
    Pai et al.2004|Pedestrian detection and tracking at crossroads
    CN102765365B|2014-07-30|Pedestrian detection method based on machine vision and pedestrian anti-collision warning system based on machine vision
    Huang et al.2004|On-board vision system for lane recognition and front-vehicle detection to enhance driver's awareness
    Sivaraman et al.2011|Combining monocular and stereo-vision for real-time vehicle ranging and tracking on multilane highways
    CN106778655B|2020-05-05|Human body skeleton-based entrance trailing entry detection method
    CN103971380A|2014-08-06|Pedestrian trailing detection method based on RGB-D
    CN106448160B|2020-04-10|Target person tracking method combining vehicle running track and monitoring video data
    CN108986472B|2020-10-30|Method and device for monitoring vehicle turning round
    Messelodi et al.2007|Vision-based bicycle/motorcycle classification
    Malinovskiy et al.2009|Model‐free video detection and tracking of pedestrians and bicyclists
    Xia et al.2015|Integrating 3D structure into traffic scene understanding with RGB-D data
    CN104680133B|2018-02-02|A kind of violation car allows people's behavior real-time detection method
    Nowosielski et al.2016|Automatic analysis of vehicle trajectory applied to visual surveillance
    Kamijo et al.2003|A real-time traffic monitoring system by stochastic model combination
    Yang et al.2014|On-road collision warning based on multiple FOE segmentation using a dashboard camera
    NL2025140B1|2022-02-22|Green signal control method and apparatus dedicated for old person crossing the street
    Deng et al.2018|Skeleton model based behavior recognition for pedestrians and cyclists from vehicle sce ne camera
    Huang et al.2016|A vehicle flow counting system in rainy environment based on vehicle feature analysis.
    Mokha et al.2015|A review of computer vision system for the vehicle identification and classification from online and offline videos
    Huang et al.2014|Pedestrian detection system in low illumination conditions through Fusion of image and range data
    Kim et al.2019|Real time multi-lane detection using relevant lines based on line labeling method
    Gao et al.2011|Crossing road monitoring system based on adaptive decision for illegal situation
    同族专利:
    公开号 | 公开日
    CN110633670A|2019-12-31|
    NL2025140B1|2022-02-22|
    ZA201907214B|2020-11-25|
    LU102035B1|2021-03-17|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    CN201910868606.XA|CN110633670A|2019-09-16|2019-09-16|Method, system and device for prolonging green letter special for old people|
    [返回顶部]